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Entropic uncertainty relations in a finite dimensional Hilbert space are investigated. Making 
use of tlie majorization technique we derive explicit lower bounds for the sum of Renyi entropies 
describing probability distributions associated with a given pure state expanded in eigenbases of two 
observables. Obtained bounds are expressed in terms of the largest singular values of submatrices of 
the unitary rotation matrix. For a generic unitary matrix of size N = 5 our bound is stronger than 
the well known Maassen and UfEnk (MU) result with a probability larger than 98% and this ratio 
increases with A'^. We also show that the bounds investigated are invariant under the dephasing 
and permutation operations. Finally, we derive a classical analogue of the MU uncertainty relation, 
which is formulated for stochastic transition matrices. 



Dedicated to Iwo Biaiynicki-Birula on the occasion of 
his 80th birthday 



I. INTRODUCTION 

The uncertainty principle is often considered as a key 
feature of quantum theory, as it expHcitly emphasizes 
the difference with respect to its classical counterpart. 
The original formulation given by Heisenberg in 1927 [T] 
which had been devoted to canonically conjugated vari- 
ables was further generalized by Robertson in 1929 for 
arbitrary two observables j^. If both observables do not 
commute, it is impossible to specify their precise values 
simultaneously. In this set-up uncertainties are charac- 
terized by the variances of both variables, and the re- 
lation provides a lower bound for the product of these 
quantities. 

Another method to describe the uncertainty is to use 
the continuous entropy of the probability distribution of 
the measurement outcomes. In 1975 Bialynicki-Birula 
and Mycielski derived the entropic formulation of the un- 
certainty relation [3] , in which the main role is played by 
the lower bound for the sum of two continuous Shannon 
entropies calculated for position and momentum proba- 
bility distributions. 

Entropic uncertainty relations, originally introduced 
for the infinite dimensional Hilbert space, were later in- 
vestigated in the case of a finite dimensional quantum 
systems. Consider a pure state \tp) belonging to an N 
dimensional Hilbert space "Hat and a non-degenerate ob- 
servable A, the eigenstates ja^) of which determine an 
orthonormal basis in Hn- The probability that this 
observable measured in \tp) gives the i-th outcome is 
Pi — \{0'i\''P)\'^ ■ The non-negative numbers pi sum up 



to unity, J2i=iPi ~ 1; ^^ that the properties of the dis- 
crete probability distribution {pi} can be described by 
the Shannon entropy, H{p) = — J^iPi luPi- 

Let H(q) denote the Shannon entropy corresponding to 
the probability vector Qj — \{bj\ip)\'^ associated with the 
second observable B. If both observables do not commute 
the sum of both entropies for any state [ip) is bounded 
from below, and the bound depends only on the unitary 



rotation matrix Uij — 



,a-*l 



The first lower bound: 



H{p)+H{q) > -2 In 



1 



^Br 



(1) 



where c = maxij | Uij \ was with the help of variational 
calculus derived by Deutsch in 1983 [4;. Maassen and 
Uffink obtained in 1988 a stronger result of the form [5] 



H{p)+H{q) >-\nc^ = B 



MU- 



(2) 



Note that for a Fourier matrix of size N , which describes 
the transition from position to momentum representa- 
tion, one has c = 1/y/N, so that Bmu = In A^. 

The result of Maassen and Uffink, while stronger than 
the Deutsch lower bound, is known to be not optimal in 
the general case. The optimal bound is known only for 
N — 2 ini IZ] ) however in higher dimensions the problem 
remains open. 

Let us mention that the entropic uncertainty relations 
were recently formulated in various set-ups jSHU]- To 
learn more about further developments in that area the 
reader is asked to consult reviews |13l [H] . 

In general, it is convenient \W to work with the Renyi 
entropy 



H^ix) 



1 



N 

In^: 



(3) 



which tends to the Shannon entropy for a ^- 1, is equal 
to — In Xmax in the hmit a — ^ cx) and is a non-increasing 
function of the parameter a [TB] • One may then look for 
bounds for the sum of two Renyi entropies of order a. 
For instance, explicit bounds in the case a = 1/2 have 
been for N = 2 recently obtained by Rastegin [1^ . 

The aim of this work is to derive a novel bound, which 
for a generic unitary U is with high probability stronger 
than (pi . We shall establish lower bounds for the sum of 
two entropies of an arbitrary order a > 0, 



that the MU bound and the bounds derived in this work 
are invariant with respect to permutation and dephas- 
ing operations. The bounds for some exemplary families 
of unitary matrices of size N = 2,3,4,5 are discussed 
in section IV. In this section we also use random unitary 
matrices to compare the precision of various new and pre- 
vious bounds. Finally, in section V we present a classical 
analogue of the Maassen-Uffink relation for an arbitrary 
stochastic transition matrix. 



Ha{p)+H^{q)>B^{U), 



(4) 



II. MAIN RESULT 



with Ba{U) depending in general on the whole matrix U. 

To improve the approaches of Deutsch and Maassen- 
Uffink, corresponding to the case a = 1, we are going 
to characterize the unitary rotation matrix U by taking 
into account all its entries. A similar idea was recently 
put forward by Grudka et al. |18j . who analyzed column 
(or row) V oi U, for which the entropy of the probabil- 
ity vector is the largest; Vi = \Uij\'^ and v'^ — \Uji\'^, 
where j = 1,...A'^ and the maximum is taken over i. 
Observe that in this notation the MU bound (pi reads 
Hi{p) + Hi{q) > Hp{v) with f3 = oo, so decreasing the 
Renyi parameter /3 would make the bound stronger. Un- 
fortunately, numerical simulations show that, an appeal- 
ing conjecture that the sum of the Shannon entropies is 
larger that H2{v) occurs to be true for A^ = 2 and A = 3 
only. 

As in this paper we use the majorization techniques let 
us briefly introduce the concept of majorization. Con- 
sider any two probability vectors x and y of sizes A and 
M, respectively. Associated vectors of size max{A, M}, 
with coefficients ordered decreasingly and zeros on addi- 
tional coordinates possibly added to the shorter vector, 
will be denoted as x and y. The vector x is called to be 
majorized by y, written x ^ y, if x,y satisfy inequalities 
for partial sums | [19] 



J2i^<J2y^ 



(5) 



i=l 



i=l 



where 7 runs from 1 to max{A, M}. Note that for 7 = 
max{ A, M} the inequality is trivially saturated as both 
vectors sum up to 1. 

The Renyi entropy is a Schur-concave function for any 
parameter a > 0, what implies that if x ^ y, then 
Ha{x) > Ha{y). In general, when a given function F 
is Schur-concave and two probability vectors satisfy the 
majorization relation, x ^ y, one obtains the inequality 
F{y) < F{x). 

This paper is organized as follows. Our main result 
— the explicit uncertainty relations for the sum of Renyi 
entropies is derived in section II. In section III we show 



In the entropic uncertainty relation (HI we bound the 
sum of entropies of two probability vectors p and q. How- 
ever, this sum can be rewritten as the single entropy of 
the product vector: 



H^{p)+H^{q) 



1 



1 — a 



ln^pf+ln^9- 



r^i'^E(p' 



(6) 
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Heir), 



where r = p ® q i& the tensor product of the classical 
probability vectors. 

Assume that p and q are given by the fixed unitary 
matrix U £ U{N) and some vector |-0) as: pi = |(J|'(/')P 
and qj — |(j|C/|-0)p, where the vectors \i) for i = 1, . . . , A 
form the orthonormal basis. It was shown by Deutsch |1] 
that 



max piqj ~ max 



Pi + q] 



1 + c 



i?i, (7) 



where as before c — max^j | Uij \ . The above result imme- 



diately implies that 



r ^ (i?i,l-i?i). 



(8) 



Since the Renyi entropies are Schur-concave we arrive at 
a first, simple bound 



Ha{p) + H^{q) ^ H^{r) > 



1 



1 — a 



ln[i?? + (l-i?i)"] 



(9) 

For any rectangular matrix X one defines its spectral 
norm, equal to its largest singular value. 



l^ll = ^max(^). 



(10) 



This non-negative number is given by the square root of 
the largest eigenvalue of the positive matrix XX^ . 

Let A{k, n) denote the set of all A: x n submatrices of 
U e U{N) obtained from U by removing N ~ k rows and 
N — n columns. We shall introduce a set of A coefficients 



Sfc — max I max ||A|| ) , (11) 

i=0,...,fc-l \AeA{k-i,i+l) ' 



a) 



0.19 _ q^o Pcreill 0.551 

-0.62 Ccr54>-0.21 -0.52 

0.52 ^1151 -0.54 -0.62 

-0.55 <^QL63>-0.50 0.19 



b) 

r 0.19 0.50 -0.64CEIS?! 

-0.62 0.54 -0.21 '^E52> 
0.52 -0.21 -0.54 €TraZ > 

1-0.551 F^Oliil 1-0.501 0.19- 



Figure 1: Ortogonal matrix U of size 4 with truncated en- 
tries. To obtain s\ we find its entry with the largest modulus, 
denoted in red boldface in panel a). To get S2 we find verti- 
cal and horizontal 2-vectors of the largest norm, marked by 
blue ellipses and green boxes respectively. Calculation of S3, 
shown in panel b) requires comparison of norms of horizontal 
(green boxes) and vertical (blue ellipses) 3-vectors of U and 
2x2 submatrix (bold entries in red) with the largest norm. 



where fc = l,2,...,A^. By construction we have c — s\ < 
S2 < • • • < sjv = 1) so that si is equal to the modulus of 
the largest element of U. Furthermore, S2 is equal to the 
maximum of the Euclidean norm of any two-component 
part of any column or any row of [/, 



S2 = 

max'^ max 

i,Jl,J2 



(12) 



U^n\' 



\UijJ'^, max 



u^J' 



\U^J' 



SO it depends only on the moduli of U. In the case of S3 
one needs to find the maximum among Euclidean norms 
of any 3x1 and 1x3 vectors and spectral norms of any 
2x2 submatrix of U belonging to the set ^(2,2). In 
the latter case not only the moduli but also the phases of 
entries of U become important - see Fig. [T] which shows 
exemplary calculation performed for a generic orthogonal 
matrix of size 4, in which all numbers are truncated up 
to two decimal digits. 

In general, one has the bound 



Sk < max \\A\\ 

AeA{k,k) 



(13) 



Note that sjy is equal to unity as it is not smaller than 
the length of any column (or row) of U and is not larger 
than the spectral norm of the unitary matrix \\U\\ — 1. 
In the next step we define 

Rk-('-^]\ (14) 



so that (i±£) ^ Ri < R2 < ■ ■ ■ < Rn = I- Let us 
remind that i?i has been introduced in Eq. (ItI. The 
above notation allows us to formulate key results of this 
paper. 

Theorem 1. For unitary matrix of size N and any nor- 
malized vector l-ip) we have 



p®q~<Q, 



(15) 



whe 



Q — {Ri,R2 — -Ri,i?3 — R2, ■ ■ ■ ,Rn — Rn-i) ■ (16) 



Notice, that from the above theorem we obtain directly 
the following corollary. 

Corollary 1. For Q^'^^ defined as 

g^'^) = (i?i, i?2 - i?i, i?3 - i?2, . . . , 1 - Rk) (17) 

we have 

p^q^Q^ Q(^-i) -< g(^-2) ^ . . . ^ Q(i). (18) 

Theorem 2. For any unitary matrix U of size N , any 
normalized vector \tp) € "Hjv o,nd a Schur-concave func- 
tion F we have 



i^(p®g)>F(Q) = ^(Q(^-i)) 



(19) 



Corollary 2. For a unitary matrix U of size N , any 
normalized vector \ip) G "Hat and every a > we have 

Hc.{p)+H^{q)>H^{Q), (20) 

what can be extended to 

H^[P) + H^{q) > B^-^ > B^-' >--->Bl (21) 

withBl^^H^{Q(^)). 

Proof of Theorem [l] To prove the majorization re- 
lationflSlwe consider sums of elements of the vector p®q, 
i.e. Pij^Qj^ + • • • + PikQjk for some indices ii, . . . ,ik and 
ji, . . . ,jfc, such that {ii,ji) ^ {i-,n,im) for j ^ m. Simple 
reasoning gives us the inequality 

Ck—rrt \ / m \ 

'^' '^' (22) 

where p and q have the same coordinates as vectors p 
and q, but are ordered decreasingly. Using the arithmetic 
geometric mean inequality we get. 



/fe- 



m \ / m 



-m m 



k^^lJ E p^ E 9' ^K^^Li i E p^ + E <?' 

^ ^ \ ;=i / \i=i / ^ ^ \ ;=i 1=1 / 

(23) 

Now we can apply Lemma [T] proven in the Appendix to 
bound the inner sums by 



-ni ni 



y^ Pz + y^ g; < 1 + max crmax(^), (24) 

^ ^ AeAk-m,m 

where for maximum ranges over all sumbatrices of size 
{k — m) x m. Together with maximization over m we 
have 



/k—m 



max 

l<m<fe- 



(E^'+E9M<i 



Sk- 



(25) 



Thus, we finally obtain the following estimate 

Piiqn +---+Pi,qj^ < Rk, (26) 

which gives us the desired niajorization relation, 
p(g>q^ {Ri,R2-RuR3-R2,...,Rn-Rn-i)- (27) 



In the maximizing case inequality ( 23 ) can be saturated 



This follows from Remark |2] in the Appendix, as an op- 
timal choice of the vector \ip) implies that both terms in 
the right hand side of ( p3| are equal, so the geometric 
and arithmetic mean coincides. D 



l0g(2)r 



rlog(2) 




III. EQUIVALENT UNITARY MATRICES AND 
ENTROPIC UNCERTAINTY 



Figure 2: Bound (201 for rotation matrix of size N — 2, ob- 
tained for different Renyi parameters a = 1/2,1,2,00 as a 
function of parameter 6. 



We say that two unitary matrices U and V are equiv- 
alent U ^ V ii there exist permutation matrices Pi , P2 
and diagonal unitary matrices Di, D2, such that 



V = P1D1UD2P2. 



(28) 



It is easy to note, that any unitary matrix is equivalent 
to one with real elements in the first row and the first col- 
umn which is often called dephased [15J. Another simple 
fact is that any 2x2 unitary matrix is equivalent to a 
real rotation matrix 



U{2) 3 U r^0{9) = 



COS f 

sin 6 



— sm f 
cos 6 



e 30(2). 



(29) 



The probability distribution induced by a normalized 
vector Jt/i) is invariant with respect to diagonal unitary 
operations. The permutation matrix changes only an or- 
der of coordinates, thus the above equivalence does not 
affect the left hand side of relation Q . This observation 
suggests that one can restrict an attention to functions 
B[U) which are invariant with respect to the equivalence 
relation. It is easy to note, that the functions i?£)(t/) 
and Bmu{U), as well as our lower bounds are invariant 
with respect to the introduced relation. Thus, to analyze 
the entropic uncertainty relations for unitary matrices of 
order N , one can restrict an attention to the A^^ — 2A^ — 1 
dimensional set of the dephased matrices. 

IV. LOW DIMENSIONAL EXAMPLES 

To demonstrate in action the new uncertainty rela- 
tion proven above consider first the case N = 2. As 
stated in the previous section it is enough to consider 
one-parameter family of rotation matrices since any 2x2 
unitary matrix is similar to a rotation matrix O{0) given 
in (29). In Fig. [2] we present the bound ( [20| for different 
values of parameter a. 



In the case of A^ = 3, 4, 5 we consider a one parameter 
family of unitary matrices, given by PP , where f3 € [0, a] 
and P is a circular shift permutation, which in the case 
of A^ = 3 reads 



-Ps = 



1 
1 
100 



(30) 



In Figs, (pi pi k5|, we present the comparison of the 
bounds ( [2l| ) with the Deutsch bound (fTl) and the 
Maassen-Uffink bound (pi for the family of unitary ma- 
trices which interpolate between identity and the Af-point 
permutation matrix P/y. 

In the case A^ = 3 we analyze a two dimensional cross- 
section of the Birkhoff poly tope of bistochastic matrices, 
and select 6(a, 6) = aPs + bP^ + {l-a-b)l, ioi < a,b< 
1, a+b < 1. Out of this equilateral triangle of bistochastic 
matrices of order A^ = 3 formed by the convex hull of 
permutation matrices P3,P| and Pg — I, only a proper 
subset corresponds to unistochastic matrices, such that 



there exists a unitary U and Bi. 



\U,., 



For unitary 



matrices associated with this subset, forming an interior 
of the 3-hypocycloid [50], we checked whether the MU 
bound Bf,ju is larger than the bound Bf. Such a set, 
denoted in light colour in Fig. |4] contains the center of the 
figure - the fiat bistochastic matrix, Bij ~ 1/3 associated 
with the Fourier matrix P3 for which the MU bound is 
sharp. 



In order to compare precision of the bound ( 20 ) for the 



standard case of Shannon entropy a = 1 we computed it 
for random unitary matrices distributed with Haar mea- 
sure on U{N) . Probability that for a given unitary matrix 
U our bound is better than the Maassen-Uffink bound, 
increases with N and reads, P — 0.815 for N = 2 and 
P = 0.971,0.972,0.983,0.990, for n = 3,4,5,6 respec- 
tively. 



2 log 



MU; 



log(8 - 4 Vz") 



MUj 




Figure 3: Comparison of bounds 1 21 1 for the family of matri 



ces Pg of order N = 3, where Pg is a circular shift permuta- 
tion. Black dotted line represents the Deutsch bound Bd 111, 
red dashed Maassen-Uffink bound Bmu (pl and solid lines 



represents bounds Bi (21 1 for fc = 1, 2 




Figure 4: The difference between Maassen-Uffink bound 
Bmu (121 and bound Bi ( 20 1 for unitary matrices U of size 
A^ = 3 corresponding to the cross-section of the set of bis- 
tochastic matrices. In the blue region the MU bound Bmu 
is lower than the bound Bf, while the opposite is true in the 
yellow region. 



V. CLASSICAL ANALOGUES OF MU BOUNDS 

In the classical case we discuss an A^-point probabil- 
ity vector P and its image with respect to a stochastic 
matrix, P' — TP. Stochasticity conditions, Tij > and 
J2i'^ij — 1 assure, that P' is also a normalized probabil- 
ity vector. For a stochastic matrix T and a probability 
vector P, Slomczynski established [21] the following in- 
equality for the Shannon entropy Hi: 




Figure 5: Comparison of bounds Sf for family of matrices 
P4 , where P G W(4) is a circular shift permutation. Black 
dotted line represents Deutsch bound Bb 111, red dashed 
Maassen-Uf fink bound Bmu I2I and solid lines represents 



bounds Bf (21 1 for k 



-2 log 




Figure 6: As in Fig.([5l , comparison of bounds Bi for family 
of matrices P5 , where P £ Zi(5) is a circular shift permu- 
tation. Black dotted line represents Deutsch bound Bo (fTJ, 
red dashed Maassen- Uffin k bound Bmu ^ and solid lines 
represents bounds Pf (21 1 for fc = 1, 2, 3, 4. 



r(p) 



Here H\'{T) denotes a statistical mixture of columns 
of the matrix T with weights pi. i.e. H^ (T) = 



"YliiPiHiiti). Using inequality (311 we obtain 
Hi{TP) > H'f\T) = y^p.HiiU) > minHiiU 

^ — ^ i 

■i 

which gives us 

iJi(P) + Hi(P') > i/i(P') > minffi(f,). 

i 

We can continue the estimate and write 

Hi{P) + HiiP') > Hi{P) > miuH^iU) 

i 

= min(— log(maxrji)) = — log k, 



(32) 



(33) 



(34) 



Ap) 



HfiT) < Hi{TP) < H\^'{T) + Hi{P) 



(p), 



(31) 



where k — niax^j Tji . 

In this way we obtain an analogue of the Maassen- 
Uffink uncertainty relation for the classical maps repre- 
sented by stochastic matrices. The sum of the Shannon 



entropy of any vector P and the entropy of its image 
P' = TP is bounded form below by the logarithm of 
the inverse of the largest element of the transformation 
matrix. 



VI. CONCLUDING REMARKS 

The problem of establishing optimal entropic uncer- 
tainty relations for any two observables, the eigenbases 
of which are related by a unitary rotation matrix U of 
size N , remains open for iV > 3. However, in this work 
we produced a family of inequalities for the sum of the 
Renyi entropies Ha of an arbitrary order which typically 
are stronger than the bounds existing in the literature. 
For instance, in the standard case of a = 1, correspond- 
ing to the Shannon entropy, our result (25) applied to 
a random unitary matrix of size N — Z gives a bound 
stronger than the Maassen-Ufhnk result (2) for a vast 
majority of 97% cases. 

It is worth to emphasize that the majorization tech- 
niques applied here enable one to obtain explicit bounds 
for any Schur-concave functions of the probability vector. 
The explicit formulae for the components of the majoriz- 
ing vector Q derived in this work are expressed in terms 
of spectral norms of submatrices of the unitary matrix 
U analyzed. As this norm is equal to the largest singu- 
lar value of the submatrix |22| , our bounds are directly 
computable. These bounds are shown to be invariant for 
any unitary matrices equivalent up to permutation and 
dephasing. 

We shall mention that majorization techniques are 
used in the description of quantum entanglement [23}- 
125] . For instance the bipartite entanglement criteria by 
Giihne and Lewenstein [23] rely on the lower bound for 
the sum of two Renyi entropies. Our results can be imme- 
diately incorporated in that framework, providing sharp- 
ened entanglement criteria. 

As a side remark we presented a result analogous to 
the Maassen-Ufhnk bound, but formulated for a classi- 
cal map described by a stochastic transition matrix T. 
The sum of the Shannon entropies of an arbitrary initial 
probability distribution P and its image TP is bounded 
from below by minus logarithm of the largest entry of T. 

Note added. After this work was completed we learned 
about a very recent work of Friedland, Gheorghiu and 
Gour [26 . These authors independently use majorization 
techniques to establish entropic uncertainty relation anal- 



ogous to ( 20 1 , also valid for any Renyi entropies and ar- 



bitrary Schur-concave functions. These powerful bounds 
can be used to characterize generalized quantum mea- 
surements described by an arbitrary number of positive 



operator valued measures (POVM). 
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Appendix A: Useful lemma 

Here we present the lemma which is the main ingredi- 
ent of the proof of the Theorem [l] 

Lemma 1. Let |1), |2), . . . , \m) and |ai), [02) . . . |a„) he 
two orthonormal sets of vectors, then 

/ m. n \ 

inax 5]|(z|V)|^ + ^|(a.|^)|M=l + ai(A), (Al) 



W 



\i=l 



i=l 



where (yi{A) is a leading singular value of rectangular 
matrix A = {aij}"^'",j=i f"'^ O'ij = ("^li)- 

Remark 1. Note, that in the case m ^ I, matrix A has 
the form 



Oil 

021 



A = 



(A2) 



so its norm is equal to the length of the vector, (JiiA) = 

Remark 2. Note, that one can construct a vector [ip) 
which maximizes left hand side of iAlV. If we denote 



(l^o), |'7o)} = argmax[Re(,ei?7> -10 e lin{\l),. . . , |m)}, 

|?7) e Hn{|ai),...,|a„)}], 
(A3) 

we take \ip) as a vector proportional to the sum |Co) + |^o)- 
For this vector one can show that 



Ek*I'^)I' = Ek«'I'/^)I'- 



(A4) 



Proof of lemma: We begin by rewriting the left hand It is easy to calculate, that 



side of Eq. ( Al ) in terms of matrix multiplication 



inaxK]|(z|^)P+5]|(a,:|V>N 
= max||C|V')|P - (tI{C) = Ai(CC^), 



CC^ = 



%n At 

A I„ 



(A7) 



(A5) 



where the matrix C is defined as 

(2| 



[2 
[3 

[4; 

[5 

[6; 

[7; 

[8 
[9 

[lo; 

[11 
[12 
[13 



/ (2\ \ 



c 



(ml 
(ail 
(a2| 



(A6) 



Next we derive the formula for eigenvalues of matrix CC^ 



Ai(CCt) = 1 + Al ( ° ^^ ) = 1 + ^i(A). (A8) 



The last equality follows from Jordan's definition of sin- 
gular values and can be found e.g. in book [22j. □ 
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